Texture error recovery method using edge preserving spatial interpolation 



DESCRIPTION 



Background of Invention 

[Para 1 ] 1 . Field of the Invention 

[Para 2] The present invention relates to a method of recovering texture 

data in video streams, and more specifically, to a method of recovering 
texture data for error blocks in video streams using spatial interpolation. 

[Para 3] 2. Description of the Prior Art 

[Para 4] Video streams are composed of many macro blocks. It is inevitable 
that some of the blocks in a video stream may have errors when transmitting. 
The macro blocks containing errors are referred to as error blocks. Methods 
have been developed for reconstructing error blocks in order to clean up the 
video signal. The blocks surrounding the error block are analyzed, and the 
error block is reconstructed to be similar to the surrounding blocks. Each 
block contains a plurality of pixels. For the following disclosure, it will be 
assumed that each block is a set of 1 6x1 6 pixels. 

[Para 5] Please refer to Fig.1 . Fig.1 is a diagram of a video frame 5 
containing an error block 1 0. The error block 1 0 is shown in the video frame 
5, surrounded by other blocks 1 2. The prior art method of reconstructing the 
error block 10 contains several steps. First of all, the method calculates a 
gradient for each pixel in the surrounding blocks 1 2. Thereafter, the texture 
edge is detected by comparing the pixel gradients to a threshold level. The 
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gradient directions of tine pixels in tPie surrounding blocl<s 12 fall into eight 
classes, which are illustrated in Fig. 2. Eight surrounding pixels 20 in Fig. 2, 
which are labeled 0 to 7, present eight different directions extending from a 
central pixel 1 5. Each of these eight directions covers an angle area of 22.5 
degrees. For each of the pixels in surrounding blocks, the texture edge 
extending direction of one pixel can be calculated using its gradient 
direction. If the texture edge extending direction runs through the error 
block 1 0, a counter corresponding to that direction will be accumulated with 
the gradient magnitude of the pixel. Once the texture edge extension has 
been calculated for each of the pixels in the four surrounding blocks, the 
counter totals are used in calculating filtering weights. The error block 10 is 
then reconstructed by weight filtering its surrounding boundary pixels from 
blocks 1 2. The filtering weights correspond to the eight edge extending 
directions and further to the eight pixels shown in Fig. 2. To perform the 
weight filtering, the texture data of the surrounding pixels of the error pixel 
will be multiplied with corresponding weights and then averaged for the 
reconstructed result. The weight filtering is performed for each pixel of the 
error block 1 0 to reconstruct the whole error block finally. 

[Para 6] Unfortunately, the calculating the texture edge extension for each 
of the 8 sections is complicated and requires heavy computation. 



Summary of Invention 

[Para 7] It is therefore an objective of the claimed invention to provide a 
method of interpolating texture information for an error block in a video 
stream in order to solve the above-mentioned problems. 

[Para 8] According to the claimed invention, a method of recovering texture 
information for an error block in a video stream includes locating an error 
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block, applying an edge detection spatial filter on blocks surrounding the 
error block to detect texture edges, each block containing a plurality of 
pixels, generating filtering results of the plurality of pixels, and identifying 
first pixels surrounding the error block having texture data above a 
predetermined threshold value. The method also includes selecting first 
pixels one by one and checking the texture data of pixels extending from the 
selected first pixel in a plurality of predetermined directions for determining 
a direction of the texture edge, accumulating the filtering results of pixels 
that are located on the texture edge in a selected direction using a 
corresponding counter, determining filtering weights based on the 
accumulation results of each counter corresponding to the predetermined 
directions, and reconstructing the texture data of the error block in the 
spatial domain based on the texture data of surrounding pixels of the error 
block. 

[Para 9] It is an advantage of the claimed invention that checking the 
texture data of blocks extending from the first pixels in the plurality of 
predetermined directions is simplified in the present invention for reducing 

complexity of the texture recovery operation and for reducing the number of 
calculations required. The claimed invention does not require gradients to be 
calculated, and thereby requires fewer overall calculations be performed. 

[Para 1 0] These and other objectives of the present invention will no doubt 
become obvious to those of ordinary skill in the art after reading the 
following detailed description of the preferred embodiment that is illustrated 

in the various figures and drawings. 



Brief Description of Drawings 

[Para 1 1 ] Fig.1 is a diagram of a video frame containing an error block. 
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[Para 1 2] Fig. 2 presents the relationship between the surrounding pixels of 
the error pixel with the edge extending directions. 

[Para 1 3] Fig. 3 illustrates checking texture edges in a plurality of directions 
according to the present invention. 



Detailed Description 



[Para 14] The present invention method of recovering texture data for error 
blocks in video streams using spatial interpolation starts out by identifying 
error blocks. This identification can be performed using any of the prior art 
identification methods. Once an error block has been identified, a matrix is 
applied to the four surrounding blocks for filtering the surrounding blocks 
with an edge detection spatial filter. Although many different matrices could 
be applied, matrix M is shown below as an example. 

-1 -1 -1] 



M = 



-1 8 -1 
-1 -1 -1 



[Para 1 5] A threshold is set to detect the texture edge by only considering 
pixels whose filtering results are above a threshold value. As an example, the 
threshold may be set equal to 64. 

[Para 1 6] Please refer to Fig. 3. Fig. 3 illustrates checking texture edges in a 
plurality of directions according to the present invention. After the pixels with 
its filtering result above the threshold have been calculated, the texture edge 
pixels are checked one by one in eight different directions D0-D7 to 
determine if other pixels in that direction also lie on the texture edge. Pixels 
are checked one at a time from left to right in a row. Once a row is 
completed, the next row down is checked until the pixels in all of the rows 
have been checked. As shown in Fig. 3, a current pixel 40 is the texture edge 
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pixel currently being checked. The eight directions D0-D7 extend to the right 
of the current pixel 40 or down from the current pixel 40. None of the eight 
directions D0-D7 extend directly to the left of the current pixel 40 or up from 
the current pixel 40. This is because pixels above the current pixel 40 or 
directly to the left of the current pixel 40 have already been checked by 
previous iterations. 

[Para 17] In a preferred embodiment of the present invention, eight 
directions D0-D7 are used, where a 22.5-degree angle separates adjacent 
directions. There is still a limiting condition, however. The checking on the 
directions Dx (x=0, 1 , ... 7) should be skipped if the edge extending on this 
direction cannot go through the error block area. 

[Para 1 8] As mentioned above, the eight directions are used to determine if 
other pixels in those directions also lie on the texture edge. To avoid 
repeated calculations, a group of flags can be used to record whether groups 
of pixels have already been checked in a specified direction. If the flag 
indicates that all pixels in that direction have already been checked, those 
pixels do not need to be checked again. 

[Para 1 9] In order to reduce spatial noise, the checking of texture edge 

pixels in a specific direction will be stopped if a predetermined number of 
consecutive pixels are found not to be on the texture edge. For strictly 
reducing noise, the predetermined number of consecutive pixels is set to be 
a low number. For example in directions DO, D2, D4, and D6, the 
predetermined number of consecutive pixels can be set as 2 pixels. For 
directions Dl , D3, D5, and D7, the predetermined number of consecutive 
pixels can be set as 1 pixel. For less strictly reducing noise, the number of 
consecutive pixels can be set to larger numbers. As a result, if the current 
pixel 40 is an isolated edge pixel, which means no pixel is found on the 
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texture edge after checking for this pixel, the pixel 40 will be thought as a 
noise pixel and not considered in subsequent process. 

[Para 20] In general, once the eight directions extending from the current 
pixel 40 have been checked, the filtering results of texture edge pixels 
located on that direction would be accumulated with a counter corresponding 
to that direction. 

[Para 21] Based on the accumulation results, the filtering weights 

corresponding to the eight edge extending directions can be calculated. 
Thereafter, the texture of the error block is reconstructed similarly using the 
same weight filtering as that in the prior art. By the reconstruction of the 
texture of the error block, the overall quality of the video stream will be 
improved, and will look less noisy. 

[Para 22] In contrast to the prior art, the present invention does not require 

gradients to be calculated, and thereby requires fewer overall calculations be 
performed. 

[Para 23] Checking the texture data of blocks extending from the current 
pixel in the plurality of predetermined directions is simplified in the present 
invention for reducing complexity of the texture recovery operation and for 
reducing the number of calculations required. 

[Para 24] Those skilled in the art will readily observe that numerous 

modifications and alterations of the device and method may be made while 
retaining the teachings of the invention. Accordingly, the above disclosure 
should be construed as limited only by the metes and bounds of the 
appended claims. 
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